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Abstract 

We consider the moduli spaces of representations of the fundamental group of a 
surface of genus 5 ^ 2 in the Lie groups SU(2, 2) and Sp(4,]R) . It is well known that 
there is a characteristic number, d, of such a representation, satisfying the inequality 
\d\ ^ 2g — 2. This allows one to write the moduli space as a union of subspaces indexed 
by d, each of which is a union of connected components. The main result of this 
paper is that the subspaces corresponding to d = ±{2g — 2) are connected in the case 
of representations in SU(2, 2) , while they break up into 3 • 2^^ + 2g — A connected 
components in the case of representations in Sp(4,R). We obtain our results using 
the interpretation of the moduli space of representations as a moduli space of Higgs 
bundles, and an important step is an identification of certain subspaces as moduli 
spaces of stable triples, as studied by Bradlow and Garcia-Prada. 

1 Introduction 

Let S be a closed Riemann surface of genus g ^ 2 and let G be a connected Lie group. 
Consider the space of reductive representations of the fundamental group of S in G modulo 
the action of G by conjugation, 

Mg = Hom(7ri(S),G)+/G, 

the superscript " + " indicating reductive representations. As is well known, Aic can also be 
identified with the moduli space of reductive flat G-bundles over S and it has an algebro- 



geometric interpretation as a moduli space of Higgs bundles (see Hitchin |T^, |T( 

In this paper we study the connected components of A^g in the cases G = Sp(4, M) 
and G = SU(2,2). Previous work on this type of problem includes the determination 
of the number of connected components of A4g for the groups PSL(2,M) and PSL(2,C) 
by Goldman [^, for the groups PSL(n,R) {n ^ 3) by Hitchin |T^, and for the groups 



PGL(2, M) , PU(2, 1) , and U(p, 1) by Xia |2|, |5 



The first observation is that there is a characteristic number, d, which comes from a 
characteristic class of the bundle obtained from a reduction of structure group to the maximal 
compact subgroups U(2) C Sp(4,M) and S(U(2) x U(2)) C SU(2,2), respectively. It is well 
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known that this satisfies the Milnor-Wood type inequahty \d\ ^2g — 2 (cf. Section |^). This 
allows one to write 



A^G = -M-(29-2)U---UA< 



23-2, 



where each is a union of connected components. We can then state our main result as 
follows. 

Theorem. The subspaces Aio C J\Ag are connected for G = Sp(4, M) and G = SU(2, 2) 
and the subspaces A4±{2g-2) ^ '^su{2,2) are connected. The subspaces A4±{2g-2) ^ -^Sp(4,iR) 
have 3 ■ 2^^ + 2g — 4 connected components. 

The most remarkable aspect of this result is that A4±(2g-2) ^ Sp(4, R) breaks up into a 
number of different connected components, which are not detected by the first Chern class 
given by reduction of structure group to U(2) C Sp(4, M) . It seems likely that the remaining 
Aid are connected and we hope to come back to this question on a later occasion. 

The method we use for studying the connected components is via the algebro-geometric 
interpretation of A4g as a moduli space of Higgs bundles, due to Hitchin [0, [l^. (A Higgs 



bundle is a pair (£',$), where E is a holomorphic rank n degree d vector bundle and 
$ G End(£')o ® K) , see Section for more details.) From this point of view one can 

define a Hamiltonian circle action on the moduli space and one uses a moment map for this 
action as a Morse function, in the sense of Bott, to obtain topological information about the 
space (cf. Hitchin |T3| , and Gothen |T^). The central point is then to identify the critical 



submanifolds of the Morse function and to obtain topological information about them. In 
particular, to obtain information about connected components, one needs to consider the 
local minima of the Morse function. It should be remarked that the moduli spaces have 
singularities and so one cannot directly apply Morse theory, however, in the case of the 



determination of connected components this difficulty can be circumvented (see Sections ^ 
and PI). 



In this paper we show that certain critical submanifolds, corresponding to local minima 
of the Morse function, can be identified with moduli spaces of stable triples, or spaces closely 
related to them, as studied by Bradlow and Garcia-Prada |IU|. In the cases d = and 
\d\ = 2g — 2 the structure of the moduh spaces of triples is particularly simple and this allows 
us to prove the theorem above. In the case of G = Sp(4, R) and \d\ = 2g — 2 we further 
need to use a spectral curve (see Hitchin [Q) which is an unramified covering of S and the 
mod 2 index theorem of Atiyah-Singer to identify the local minima of the Morse function as 
certain Prym varieties associated to the covering of S. 

This paper is organized as follows. In Section |] we recall the basics of the theory of Higgs 
bundles and their relation to representations of the fundamental group of a surface in a non- 
compact Lie group. We also recall the concept of a Q -bundle, of which a holomorphic triple is 
a special case, and prove a theorem (Theorem |2.3D which is essential for the identification of 
the subspace of local minima with a moduli space of holomorphic triples. Finally we describe 
the Morse theory on the moduli space and, in particular, we describe how to find the Morse 



indices. It was observed by Hausel that our results on the Morse indices, together with 



a theorem of his, imply a theorem of Laumon ||18| in this context: the nilpotent cone in 



the moduli space Ai of rank n Higgs bundles is a Lagrangian subvariety with respect to 
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the holomorphic symplectic form on Ai . We end this section by briefly describing this. In 
Section ^ we reprove the known bound \d\ ^ 2g — 2, using Higgs bundles; we include the proof 
because it gives some extra information which is important later on (cf. Proposition |3.2| ). 
In Section ^ we analyze the local minima of the Morse function on the space Aic for 
G = Sp(4, R) and G = SU(2,2) in detail. Finally, in Section we finish the proof of our 
main theorem, using the previous results. 

Acknowledgments. Part of this paper is based on my Ph.D. thesis and I would like to thank 
my supervisor Nigel Hitchin. I also benefited from workshops organized by the VBAC re- 
search group under the European algebraic geometry networks AGE and Europroj, supported 
by the EU. This work was partially supported by Statens Naturvidenskabelige Forskningsrad 
(Denmark), and by the Fundagao para a Ciencia e a Tecnologia (Portugal) through the Cen- 
tro de Matematica da Universidade do Porto and the project Praxis 2/2.1/MAT/63/94. 

2 Higgs bundles and the topology of moduli spaces 
2.1 Higgs bundles 

In this section we review some basic facts about Higgs bundles and set up notation. For 
details see Hitchin [|T3| and Simpson [^. 

Let Gc be a complex semi-simple Lie group with Lie algebra Qc. Let G C Gc be a 
maximal compact subgroup with Lie algebra q. Thus there is a compact real structure 

0c — ^ 0c whose fixed point set is 0. Denoting the — 1-eigenspace of r by 0"*" we then 
have 0c = © 0"^ • 

Non-abelian Hodge theory gives an equivalence between reductive representations of 
7ri(S) in Gc and Higgs bundles over S, which we now describe. Let 

p: 7ri(S) Gc 

be a reductive representation. This data is equivalent to having a principal bundle 

Pc = S Xp Gc 

with a reductive fiat connection B G ^^^(-Pc;0c) (here S is the universal cover of S). 

If we have a metric in Pc > i-e. a reduction of structure group from Gc to G, we can write 

i*B = A + e 

where i: P "-^ Pq is the inclusion of the principal G-bundle P given by the reduction of 
structure group, A is a connection on P, and 6 G Q^{P]g^) is a tensorial form, which can 
therefore be thought of as an element of ^^(S; P XAd 0"*") • 

Given a complex representation of G (e.g. the adjoint representation on 0c), we have 
the usual decomposition of the covariant derivative d^ in its (1,0)- and (0, l)-parts: 

dA = dA + Ba- 

Similarly, we can write 

^ = $ - r($). 
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for a unique $ G f2^'''(S; AdPc) (by abuse of notation, we denote by r the combination of 
the compact real structure r on 0c and conjugation on the form component). 

Corlette ||^ and Donaldson ||^ proved that there exists a harmonic metric in P , that is, 
a metric such that (A, $) obtained via the above procedure satisfy Hitchin's equations 

F(A)-[$,r($)]=0, 
(9a$ = 0. 

This, in turn, gives a principal Higgs bundle, i.e. a pair (Pc, $) consisting of a holomorphic 
principal bundle P (with holomorphic structure defined by 8^) and a Higgs field $ G 
if°(S; AdPc -ft'), where K denotes the canonical bundle of S. Given a representation, 
V, of Gc one then obtains a Higgs vector bundle (£",$), where = Pc Xg^, 1/ and $ G 
if°(S; End(i?) ® /T) . The two main examples we have in mind are the adjoint representation 
^ = 0c and the fundamental representation of Gc = SL(n, C) . If the original representation 
p of 71"! (S) is irreducible then (-E, $) is stable, i.e. 

/i(P) < /i(P) 

for any proper non-trivial ^-invariant subbundle F of E (here fi{E) = deg{E)/Tk{E) is 
the slope of the holomorphic bundle E). Allowing equality in the above inequality gives the 
notion of a semi-stable Higgs bundle. Finally, if p is reductive, then the corresponding Higgs 
bundle is poly-stable, i.e. it is a direct sum of lower rank Higgs bundles, all of the same slope. 
By a theorem of Hitchin [jl5l and Simpson |2^, the above procedure can be reversed, by 



finding a harmonic metric in the Higgs bundle. This produces a reductive representation of 
7ri(S) from a poly-stable Higgs bundle. This gives a homeomorphism 

^Gc^Hom(7ri(S),Gc)+/G'c. 

where A4gc is the moduli space of poly-stable principal Gc Higgs bundles. 

We finish by recalling the description of the Zariski tangent space to A4gc at (Pc, $) 
given by Biswas and Ramanan . This is the first hyper-cohomology (Gc) of the complex 
of sheaves 

C'c-. O (Ad Pc) (Ad P0K). (2.1) 

From this they deduce the long exact sequence 



e°(G') i7°(S; AdPc) ^ if°(S; AdP® iT) T(^p^,^)Mgc 

H\j:;AdPc) H\J:; Ad P^K) M\Cc) ^ 0. (2.2) 

(Pc, $) is a smooth point of the moduli space if E[°(G*) and H^(G*) vanish (by Serre duality, 
it is sufficient to check that H[°(G*) =0). From this one sees that stable Higgs bundles 
represent smooth points of the moduli space. The dimension of A^Gc can be calculated 
using Riemann-Roch to be 

dimcA^Gc = x((^(AdP®K))-x(0(AdPc)) = 2dimc0c((7-l) 
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2.2 Real groups 

Hitchin |jl5|, [l^ showed how to use Higgs bundles to study representations of 7ri(S) in real 
(non-compact) Lie groups. Next we recall the relevant parts of this theory. 

Let Gr C Gc be a real form, given by a real structure cr: gc — * 0c- Let K d Gr he a. 
maximal compact subgroup and let 6 C 0,. be the corresponding inclusion of Lie algebras. 
Let 6"*" be the orthogonal complement to 6 with respect to the Killing form, then we can 
write Qr = t ©fi-*" , where the Killing form is negative definite on i and positive definite on 6-*- . 
Define a complex linear involution (p'- Qc Qc by 0|tf. = 1 and 0|j± = —1. Define another 
real structure on gc by r = cr0 = 0cr. It is then easy to see the that the corresponding real 
subgroup G C Gc is a maximal compact subgroup and, clearly, t = gH Qr- 

Now suppose that we have a reductive representation of 7ri(S) in Gr and let B be the 
associated flat connection on the principal G,- -bundle Pcr- The theorem of Donaldson and 
Corlette also applies in this case and gives a reduction of structure group to C G,-: let 
i: Pk ^ Pgc be the inclusion of principal bundles given by combining the reduction of 
structure group with the inclusion Gr C Gc. In the decomposition i*B = A + 9 , A and 
6 will be fixed by a, while t{A) = A and t{9) = —9. Thus Ba is fixed by 0, and $ is 
in the — 1-eigenspace of 0. This means that the corresponding Higgs bundle is of the form 
{Pkc,^), where 

• Pkc is a holomorphic principal Kc -bundle, 

• $ G Adj± Pk ® K) (where we use the notation Adj± Pk — Pk ^Ad ^c )• 

Conversely, such a Higgs bundle gives a representation of vri(S) in Gr- We then have a 
homeomorphism 

^Hom(7ri(S),G,)+/a, 

where is the moduli space of poly-stable Higgs bundles of the above type. Alternatively 
Aicr can be thought of as the moduli space of solutions (A, $) to Hitchin's equations 
modulo i^'-gauge equivalence: then A is a connection on a principal fC-bundle Pk and 
$ G (]^'0(E;Adj± Pif). 

The analogue to ( p.l| ) in this context is that the Zariski tangent space to A^Cr is the 
first hyper-cohomology of the complex of sheaves 

G; : 0(Ade, Pk) ^ 0(Ad,x Pk ® K), (2.3) 

where we use the notation Adt^, Pk = Pk XAd = AdPft-^,. The analogue to the long exact 
sequence ( pi^ ) is 

^ e°(G;) ^ iJ°(S; Adt, Pk) ^ H^E; Ad,x Pk ® K) ^ T^P^,^)MGr 

H\^- Ade, Pk) ^ H\^; Ad^x Pk ® K) tf(G;) ^ 0. (2.4) 

The smooth points of the moduli space are those for which HI°(G*) = HI^(G*) = and again 
the stable Higgs bundles represent smooth points. The dimension of M.Gr can be calculated 
as before to be 

dime AIg, = dimc0c(fi' - 1) = |dimcA<Gc- 



5 



We finish this section by giving two examples of this setup. First consider Gr = Sl](n,n) 
which is a real form of SL(2n, C) . The Higgs vector bundles {E, $) corresponding to repre- 
sentations of vri(S) in SU(n, n) are of the form 

E = V®V' and $ = , (2.5) 

where V and V are rank n vector bundles with A"V^(g)A"1/' = 0,b e H°{'Rom{V', V)(g)K) , 
and c G {}lom{V, V) K). Two SU(n, n) representations are conjugate if and only if 
the corresponding Higgs bundles of this form are isomorphic by an isomorphism which is of 

the form (^o g') determinant one. 

The second example is Gr = Sp(2r;,, M) ; this is a split real form of Sp(2n, C) . The Higgs 
vector bundles $) obtained from the standard representation of Sp(2?T,,C) on C^", and 
corresponding to representations of 7ri(S) in Sp(2n, M) are of the form 

E = V®V* and * = (^[1 , (2.6) 

where is a rank n vector bundle, b G H'^{S'^V ® K) , and c G H'^{S'^V* ® K) . Two 
Sp(2n, M) representations are conjugate if and only if the corresponding Higgs bundles of 

this form are isomorphic by an isomorphism which is of the form ' ^ ^ 



2.3 Q-bundles and triples 
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The special forms ( p.5|) and ( p. 61) suggest a different point of view, that of Q -bundles. This 
notion, due to Alastair King, provides a general framework for considering a large number of 
the various kinds of vector bundles with extra structure, which have been studied in recent 



years. The vortex pairs of Bradlow [Q, the triples of Garcfa-Prada, introduced in [|T0| and 
studied systematically by him and Bradlow in |^ (and also Higgs bundles), are all examples 
of Q-bundles. 

Let Q be a quiver, that is, Q is a directed graph, specified by a set of vertices Qo and a 
set of arrows Qi, together with head and tail maps h,t: Qi ^ Qq. 

Definition 2.1. A Q -bundle over a Riemann surface S is a collection of holomorphic vector 
bundles {Ei}i^Qg over E and a collection of holomorphic maps -E't(a) -E'/i(a)}aGQi • ^ 
twisted Q -bundle is given by in addition specifying a linebundle La for each arrow a. The 
maps 0a are then required to be holomorphic maps 0^ : Et(a) Eh(^a) ® La . 

We shall only consider Q-bundles of a particularly simple form: we let Q be a quiver 
with 2 vertices and exactly one arrow connecting the vertices in each direction (see fig. |I]). 

We denote the the arrows by aij , where a^j is the arrow going from j to i. Also, the 
maps will be twisted by the canonical bundle K . Thus, from now on, a Q -bundle is a pair 

E=(^,$), 

where E_ = {Ei,E2} and $ = {4>ij} ■ Here, each Ei is a holomorphic vector bundle on S 
and (pij is a holomorphic section of Hom(ii^j, Ei K) . 
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ai2 

Figure 1: The quiver Q 

A particularly interesting special case occurs when 0i2 = . The data of the above type 
of Q-bundle then comes down to a triple {Ei, E2, 0) , where G Hom(ii^i, E2) ® K) . 

If we define E2 = E2® K then this is equivalent to a holomorphic triple (£"1, £"2, 0) in the 
sense of Bradlow and Garcia-Prada . 

Given a Q-bundle E = (£,$), we can define an associated Higgs bundle $) by 
putting 

E = Ei®E2 and $ = (0^^), (2.7) 

where {(pij) is the matrix of $ with respect to the above direct sum decomposition of E. 
Note that the Higgs bundles of the form ( p.5|) or (|2.6|) arise in this way. Conversely, given a 
Higgs bundle of the special form (|2.5| ) or ( p.6|) we get an associated Q-bundle. 

There are equations for preferred special metrics in a Q-bundle, the Q -vortex equations. 
Choose a metric compatible with the complex structure on S and, for convenience, normalize 
it so that vol(S) = 27r. This of course also gives a Hermitian metric in the canonical bundle 
K . The Q-vortex equations are equations for Hermitian metrics in E\ and E2 and in our 
case they take the form 

lKF{A{) + 012012 - 021021 = tiUe, ^2 8) 

iKF{A2) + 021021 - 012012 = T-2ld£;2 

where F{Ai) is the curvature of the metric connection in ^j, A denotes contraction with 
the Kahler form of S, and 0*^ denotes the adjoint taken with respect to the metric obtained 
from the metrics on Ei and K. The parameters (ri,r2) are real, subject to the condition 



^(deg(£i)-r,rk(£,)) =0, 



1=1 



obtained by taking traces in the equations ( p.8| ), summing and integrating over S (thus there 
is really only one real parameter involved, which is usually taken to be r = T2). There is a 
stability condition for Q-bundles, such that any Q-bundle which supports a solution to the 
Q -vortex equations is a direct sum of stable Q -bundles. In our case the condition is 

2 

J](deg(F,)-r,rk(F,)) <0 (2.9) 

i=l 

for any proper Q-subbundle F of E. Note that the condition depends on the parameters 
(ri,r2). Bradlow and Garcia-Prada constructed moduh spaces of stable triples, varying 
with the parameter r. 
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We shall only need to consider the case ti = T2 = fi{E) so we shall assume this from now 
on. The stability condition (|2.9| ) can then be reformulated as 

^(F) < fi{E) (2.10) 

for any proper Q-subbundle F = ({-Fi, -F2}, {^12, 02i}) of E, and where we write F = 
Fi ©F2. 

But, obviously, F = Fi (B F2 G E is a ^-invariant subbundle, thus stability of the Higgs 
bundle $) implies stability of the Q-bundle E. The following lemma will allow us to 
conclude that the converse also holds. 

Lemma 2.2. Let {E, $) be a Higgs bundle of the form E = Ei® E2 and 

^21 ) ■ 

Let E = {{El, E2}, {(I)i2,4'2i}) be the associated Q-bundle. Let F' G E be a ^-invariant 
subbundle. Then there is a Q -subbundle E' = {{E[,E'2}, {4>i2,4>2i}) of E such that 

/i(F') ^ /i(F'), 

where E' = E[®E'2. 

Proof. Let vTj : F — > Fj be the projection on the zth factor. Let Fi C Ei and Gi C F' be the 
subbundles which are generated by the image and kernel of vTj, respectively. Then Fi and 
G2 are contained in Ei , F2 and Gi are contained in E2 , and we have sequences of vector 
bundles 



^ ^ F' ^ ^ 0, 

which are generically short exact. Hence, deg(F') ^ deg(G'i) + deg(Fj), and putting F = 
Fi F2 and G = 6*2 © Gi , it follows that 

2deg(F') ^ deg(F) + deg(G). 

Clearly 2rk(F') = rk(F) + rk(G), so that 

and therefore either yu(F) ^ /u(F') or ^{G) ^ yu(F') . Provided that F and G give Q- 
subbundles of E we can then take E' to be the Q-bundle associated to either F or G. 

It thus remains to see show that F and G are ^-invariant and, therefore, define Q-sub- 
bundles of E. First, let Xi G Fi. If we write Xi = vri(x) for some x = Xi + X2 in F', 
then 



$(x) = $(xi) + $(X2). 
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By our assumption on the matrix for $, it follows that G E2 and $(x2) G Ei. Then 

7ri($(a;)) = $(x2) G -Ei and 7r2($(x)) = $(a;i) G £'2- But G F' because F' is $- 

invariant, and thus $(x2) G -Fi and $(xi) G -F2. Of course, we can repeat the argument 
with X2 G -F2 and hence, F is $ -invariant. The proof that G is $ -invariant is similar. Let 
Xi G G'2- By assumption, G -^2- But ^2 C F' , so $(a;i) G F' as well. It follows 

that $(a;i) G Gi and thus, G is ^-invariant. We have thus seen that F and G define 
Q-subbundles of E and this finishes the proof. □ 

As an immediate consequence we have the following theorem. 

Theorem 2.3. Let Q be a quiver with two vertices and one arrow connecting the vertices 
in each direction, and let E = {{Ei, E2}, {(f)i2, (t)2i}) be a Q -bundle. Let (E,^) be the 
associated Higgs bundle as above; thus E = Ei ® E2 and 

\<P21 ) ■ 

Then E is stable if and only if {E, $) is. Furthermore, if {E, $) is poly-stable, i.e. the direct 
sum of lower rank stable Higgs bundles, these lower rank Higgs bundles are Q -subbundles of 
E. 

Proof. The only assertion that requires proof is the final one. Suppose that {E, $) is poly- 
stable and that (F', $') is a proper stable Higgs subbundle of $) with fi{F') = fi{E) . 
By semi-stability of [E, $) the bundle called G in the proof of Lemma |2.2| must then satisfy 
H{G) = fi{E) = fi{F') and, since G C F', it follows by stability of F' that G = F'. But G 
is a Q -subbundle so this finishes the proof. □ 

2.4 Connected components and Morse theory 

We shall use Hitchin's method [jl5|, [l^, which we shall now review, for finding the connected 
components of J^Cr- The idea is to use discrete invariants of fiat bundles for dividing 
J^Gr iiito subspaces which are unions of connected components. We then show that these 
subspaces are, in fact, connected. For this consider the moduli space Aicr of Higgs bundles 
as the space of solutions {A, $) to Hitchin's equations modulo gauge equivalence. The 
function 

f: M^R 

(A,<l>) ^ = / |<l>pdvol 

is proper. Thus, a subspace of is connected if the subspace of local minima of / on 
A^ is connected. 

Restrict for a moment attention to irreducible solutions to Hitchin's equations (i.e. stable 
Higgs bundles); these are smooth points of A/i. In order to identify the subspaces of local 
minima of / one uses the fact that it is a moment map for the action on Ai , given by 
(A, $) I— s> (A, e*^$): this implies that the critical points of / are exactly the fixed points of 
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the circle action. Now, {A, $) represents a fixed point if and only if there is an infinitesimal 
gauge transformation ip G y<Ad ^) such that 



dAiJ = 0, (2.12) 
[^,^ = 1^. (2.13) 

Let {E, $) be a Higgs vector bundle obtained from a complex representation of K , then 
this can be decomposed in eigenspaces for the covariantly constant gauge transformation . 
Thus 

^ = 0f/m, (2.14) 

m 

where V'ic/m = Then ( |2.13| ) shows that $: Um — > Um+i ® K . The case 

E = AdPc = Ade^ Pk © Ad^x Pk, 

is of particular interest. Since the adjoint action of G 6 and the involution on Qc com- 
mute, this decomposition of Ad Pc is compatible with the decomposition Ad Pc = 0^ Um ■ 
From ad(<l>) : Um Um+i ® K we conclude that $ G i/°(S; f/i ® -ft') and since $ G 
if°(E; Adjx Px) it follows that Ui C Ad^xPft-. Furthermore, ad($) interchanges Adt^, Pk 
and Adpx and we therefore have 



Ad^PK = ^U2k 

k 

Ad,xPx = 0[/2fc+l, 



where k is integer. 

Two additional pieces of information will be useful. The first is that there is an isomor- 
phism AdPc — > AdP^ from the adjoint bundle to the co-adjoint bundle given by the Killing 
form on qc and it is trivial to check that under this 

Um ^ U*_^. (2.15) 

The second useful piece of information is that one can calculate the value of the Morse 
function / at a Higgs bundle of the form (|2.14| ): denoting the component of $ mapping U 



to t/j+i ® K hy (f)i one shows easily, using Hitchin's equations, that 



-1 



|2 



(deg(f/,)-/i(E)rk(f/,)). (2.16) 



In particular, if fi{Ui) = ^i{E) for all i then $ must vanish. 

Finally, consider the case of local minima of / which are not represented by stable Higgs 
bundles. For simplicity we restrict attention to bundles of the form ( p.5|) or ( p.6|) . These 
are then direct sums of stable Higgs bundles of lower rank. But from Theorem p.3| we can 
conclude that these lower rank Higgs bundles decompose as direct sums of subbundles of the 
bundles appearing in the direct sum decomposition of the original Higgs bundle. 
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2.5 Morse indices 



Given a poly-stable Higgs bundle {Pkc,^) which represents a critical point of / it is nec- 
essary to decide whether it is a local minimum. This can be done using the observation of 



Hitchin that if ip acts with weight m on an element of Adgj, Pk then the correspond- 
ing eigenvalue of the Hessian of / is —m, while a weight m on (Adf^, P^) ® K gives the 
eigenvalue 1 — m. It follows that the subspace of T(^Pif^,<s>)MGr which the Hessian of / is 
negative definite is M.^{C*_), where C*_ is the complex of sheaves 

In other words, the Morse index is dim^ EI^(C" ) . At a smooth point of Aior^ where 
EP{C'_) = H^(C* ) = 0, the Morse index can be calculated using the Riemann-Roch theorem: 



dime Hi {C'_) = x (o (0 f/2fc+i ®K^)-x(o{^U2 

= {g- l)J2{MU2k) + rk(f/2fc+i)) + 5^(deg(f/2fc+i) - deg(f/2fc)). (2.17) 



k>l k>l 



The stable Higgs bundle [Prc^ ^) represents a local minimum of / if and only if this number 
is zero. 

Finally consider the case of reducible Higgs bundles. It is shown in that if M.^{C'_) = 



then we continue to have a local minimum and, on the other hand, if there is an element of 
M.^{C'_) on which / is negative and which is tangent to a smooth family of deformations of 
the Higgs bundle, then this does not represent a local minimum. 



2.6 A theorem of Laumon 

We conclude this section by a digression to the moduli space of flat Gc bundles. This space 
has a holomorphic symplectic form at its smooth points (it is hyper-Kahler) . Of course the 
theory outlined above applies in this case. In particular, if the moduli space is smooth (for 
example the moduli space of stable Higgs vector bundles with rank and degree co-prime) 
one can consider the Morse flow on it. At a critical point, we again have the decomposition 
Ad Pc = 0^ Um ■ The subspace T^o of the tangent space to the moduli space on which the 
Hessian is less than or equal to zero is of the following complex of sheaves 

O(0f/.)^o(0f/.®i^). 
The dimension of this is given by Riemann-Roch as 

dime T^o = x(o{^Um0K^)-x(o[^ f/„) ) 

= {g-l) (rk(f/o) + J2 2 MUm)) - deg(f/o). 
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But from (|2.15| ) we have deg(?7o) = and rk(t/o) + J2m>i 2rk(f/m) = dime 0c so that 

dimcT<;o = dimc(sc) = ^dimcMcc- 



It was pointed out by Hausel |14] that this fact, together with his theorem that the downwards 
Morse flow coincides with the nilpotent cone (the pre-image of under the Hitchin map), 
imphes a theorem of Laumon [0, Th. 3.1] in this context: The nilpotent cone in is a 
Lagrangian subvariety with respect to the holomorphic symplectic form on A4 . 



3 Milnor-Wood inequalities 

For any G there is a locally constant obstruction map 

02-. }lom{7ri{J:);G) ^ H\^;n^iG)). 

Note that in both cases, G = SU(n, n) and G = Sp(2n, M) , iti{G) = Z so that we have an 
integer valued function. In the case of representations in Sp(2n, M), we have 02(p) = CiiV) , 
where V is the vector bundle appearing in the decomposition ( p.6|) of the Higgs bundle 
associated to p. In the case of SU(n, n) representations, we have 02(p) = CiiV) , where V is 
the vector bundle appearing in ( p.5|) . In both cases we thus have an integer valued function 
d = deg(V^) = (ciiy), [S]) whose fibres are unions of connected components. There is an 
outer automorphism of A4g given by exchanging V with V* (in the Sp(2n, M) case), or 
exchanging V and V (in the SU(?T.,n) case). Thus, in both cases we have an isomorphism 
between o^^(c?) and 02^{—d), and it therefore suffices to consider the case d^O, whenever 
convenient. 

It is well known that there are bounds on the possible values of characteristic numbers 
of flat bundles, known as Milnor-Wood inequalities and, using Higgs bundles, we shall prove 
one for flat SU(n, n)- and Sp(2n, M) -bundles. The original inequality proved by J. Milnor 
T9| concerns SL (2, M) -bundles, while J. Wood considered SU(1, 1) -bundles. J. Dupont 



0] found a bound for any semi-simple group with finite centre, however, the inequality of 
Proposition ^?1] below for G = Sp(2?2, M) is sharper than his. Using ideas of Gromov, A. 



Domic and D. Toledo proved a general result for mappings of a surface into manifolds cov- 



ered by bounded symmetric domains, and their work implies Proposition |3.1| below. Hitchin 
obtained a proof in the case of fiat reductive SL (2, M) -bundles, using Higgs bundles, in [|15| , 
and we obtain our inequality in a similar way. The reason why we include the proof here is, 
that it gives crucial extra information about the poly-stable Higgs bundles of the form ( |2.5| ) 
and (|2.(j|) (see Proposition 



Proposition 3.1. Let p be a reductive representation o/ 7ri(S) in Sp(2n, M) or Sl]{n,n). 
Then the characteristic number d = (o2(p), [S]) satisfies the inequality 

\d\^n{g-l). 

Proof. We give the proof in case of Sp(2n, M) -representations, the SU(n, n) case being com- 
pletely analogous. 
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Let {E, <l>) be the poly-stable Higgs bundle of the form (p^) corresponding to p, as we 
already noticed d = degiV) . Without loss of generality we can assume that d > 0. In 
this case c 7^ 0, as otherwise V would be ^-invariant, and therefore violate the stability 
condition. Let U be the subbundle of V* , such that U ^ K is the vector bundle generated 
by the image of c. Similarly, let U' G V he the subbundle, which is generated by the kernel 
of c. Then the bundles U' and V (BU are both $ -invariant. We therefore get the following 
inequalities from semi-stability of {E, $) : 

deg(f/') ^ (3.1) 
rf + deg(t/)^0. (3.2) 

Note that these inequalities also hold in the case when U' = and U = V* . Next, we note 
that c induces a non-trivial global section of the linebundle 

det{V/U')-^ ^ det{U ® K), 

which therefore has positive degree, i.e. 

deg(f/') -d + deg{U) + {2g - 2) rk(c) ^ 0, (3.3) 



where rk(c) = rk(f/) is the generic rank of c. Combining this with the inequalities (|3.1|) and 
r2D, we obtain 



rf< (^-l)rk(c), (3.4) 
so d ^ n{g — 1) as claimed. □ 



The above proof gives some important additional information: from (|3.4| ) it follows that 
rk(c) = n for d > {n — l){g — 1) . In particular, in the extremal case d = n{g — 1), we 
have rk(c) = n, and furthermore equality holds in ( |3.3| ). Hence, det(c) is a non-zero section 
of a linebundle of degree 0, and we conclude that c is an isomorphism. We thus have the 
following proposition: 



Proposition 3.2. Let (-E, $) be the poly-stable Higgs bundle of the form ( p.6|) corresponding 
to a reductive representation of 7ri(S) in Sp(2n, M). // deg(\^) = n{g — 1) then c: V —>■ 
V* ® K is an isomorphism. 

Let {E, $) be the poly-stable Higgs bundle of the form ( p.5| ) corresponding to a reductive 
representation of vri(E) in S\J{n,n). If deg(V^) = n{g — 1) then c: V ^ V ® K is an 
isomorphism. □ 

This has as a consequence that there is another discrete invariant on A^sp(2n,R) and we 



shall come back to this in Section 5.2 



4 Minima of / 

In this section we determine the poly-stable Higgs bundles which represent local minima of 
the function / on M-Cr the cases = SU(2,2) and Gr = Sp(4,]R). We shall determine 



13 



which stable Higgs bundles correspond to critical points of / and then identify those which 
are local minima using ( p.l7|) . 

It will be convenient to consider the decomposition ( |2.14| ) , E = 0^ Fm of the Higgs 



bundles of the form ( p.5|) and (|2.6| ), which then gives rise to the decomposition of 

the adjoint bundle: note that we have AdPc = End(\^ © V')o (the subscript indicating 
traceless endomorphisms) when Gr = S'U{n,n), while AdPc = End(\^) © S'^V © S'^V* for 
Gr = Sp(2n, M). 

We begin by finding the minima on A1su(2,2) which are stable Higgs bundles, leaving 
the reducible ones for later. As noted in Section we only need to consider Higgs bundles 
E = V®V' with deg{V) ^ 0. 



Proposition 4.1. The stable Higgs bundles of the form ( p.5|) with deg{V) ^ 0, which cor- 
respond to a local minimum of f on A^su(2,2) o,re the ones which have 6 = 0, c 7^ 0, and 
deg{V)>0. 



Proof. Let {E, $) be a Higgs bundle of the form ( |2.5| ) which represents a critical point 
of /. E comes from the standard representation of S(U(2) x U(2)) on © and the 
infinitesimal gauge transformation ip which produces the decomposition E = is 
fibrewise in 5(u(2) x u(2)). Hence each of the bundles Fm is of the form Fm = Fmi © Fm2 
where Fmi = ViCiFm C for z = 1, 2. We claim that either Fmi or Fm2 must be zero (unless 
E = Uo). To see this, let mo be the smallest m such that Fmi and Fm2 are both non-zero. 
Then $([/mo-i) is contained in either V or V , since the same is true for Umo-i and $ 
interchanges V and V . Without loss of generality we may suppose that $([/mo-i) ^ ^• 
Then each of the bundles 



F„ © n F„ 



m<mo m^mo 

and 



v^' n F„ 



m 



is ^-invariant, and so we have a decomposition of {E, $) as a direct sum of lower rank Higgs 
bundles. This is impossible because {E, $) is stable. 

Let r = (rk(Fm)) be the rank vector whose entries are the ranks of the bundles Fm- We 
analyze the possibilities for r case by case. 

1st case: r = (1, 1, 1, 1) . Note that = tr('?/') = i ^mrk(Pm)- In this case we therefore 
have E = -F-3/2©-^-i/2ffi-^i/2©-F3/2 , where each F is a linebundle. Hence the decomposition 
i UM ) of Ad Pc is of the form 



Ad Pr = U. ©•■■©[/: 



3? 



where 



U2 = Hom(F_3/2, F1/2) © Hom(F_i/2, F3/2), 
f/3 = Hom(F_3/2,F3/2)- 
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The formula ( p.l7| ) for the Morse index then takes the form 

dime (C") = 3((7 - 1) + deg(F3/2) - deg(F_3/2) 

- (deg(Fi/2) - deg(F_3/2) + deg(F3/2) - deg(F_i/2)) 
= 3(^ - 1) + deg(F_i/2) - deg(Fi/2). 

Now we note that -F1/2 © -^3/2 is a $ -invariant subbundle of E and thus, by stabihty, 
deg(Fi/2) + deg(F3/2) < 0. Combining this with the above result we get 

dime (C*) > 3ig - 1) + deg(F_i/2) + deg(F3/2). 

But since $ interchanges V and V we must have V = F_3/2 © F1/2 and V = F3/2 © -F-1/2 
or vice-versa. Therefore \d\ = |deg(V)| = |deg(V)| = |deg(F_i/2) +deg(F3/2)|. Combining 
this with the above inequality we get 

dimce^(C!:) > 3{g - 1) - \d\ ^ 0, 

where the last inequality comes from the Milnor-Wood inequality \d\ ^ 2{g — 1) of Propo- 



sition |3.1| . We conclude that a critical point of this type always has strictly positive Morse 
index and hence it cannot be a local minimum of / . 

2nd case: r = (1,2,1). Again using ^mrk(Fm) = we see that in this case E = 
F_i © Fo © Fi . We then have Ad Pc = © ■ ■ ■ © and 

f/2 = Hom(F_i,Fi), 

and so, from ( p.l7| ), we get 

dimcei(C") = g-l- (deg(Fi) - deg(F_i)) 
= ^-l-(2deg(Fi) + deg(Fo)), 

where the second equality is due to the fact that deg(-E') = 0. Since Fq © Fi and Fi are 
^-invariant we get from stability that deg(Fo) + deg(Fi) < and deg(Fi) < 0. Hence 
2deg(Fi) + deg(Fo) < 0, which shows that dimcIHI^(C*) > 0. Therefore a critical point of 
this type cannot be a minimum of / either. 

3rd case: r = (1, 1,2) (or r = (2, 1, 1) ). In this case E = F^^ © © where 
V = Fjni®Fm2 and V = F^g (or vice- versa) . Since $ interchanges V and V , it follows that 
^\Fmi = and so, (F, $) is reducible. Thus this case cannot occur. The case r = (2, 1, 1) is 
analogous. 

4th case: r = (2, 2) . In this case F = F_i/2 © Fi/2- Then Um = for m ^ 2 and hence 
we see from ( p.l7| ) that these critical points are local minima of /. Clearly F_i/2 = V and 
Fi/2 = V , OT vice- versa. If V = F1/2 it would be ^-invariant and so deg(\^) < which is 
absurd. Thus, in fact, V = F_i/2 and V = Fi/2- In the notation of ( p.5[ ) this means that 
c = $|y and b = $|y/ = 0. This gives the minima with deg{V) > 0. Finally, note that 
if deg{V) = deg(\^') = then either V or V is a ^-invariant subbundle which violates 
stability. Thus there are no stable Higgs bundles with deg{V) = which are local minima 
of/. □ 
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The fact that there is another discrete invariant for flat Sp(2n, M) -bundles (cf. Section 5.2 ) 
is reflected in the difference between the previous and the following result. 



Proposition 4.2. The stable Higgs bundles of the form ( p.6| ) with deg(V^) ^ 0, which cor- 
respond to a local minimum of f on A^sp(4,R) ore the ones which have 

i) b = 0, c^O, and deg{V) > 0. 

a) deg(V^) =2g -2, V = Li® L2, and $ of the form 

/O c\ 
5 


yo 6 0/ 

with respect to the decomposition E = V ®V* = Li® L2® L^^ ® L^^ . 

Proof. This is analogous to the proof of Proposition ^]l|. However, in this case the infinites- 
imal gauge transformation if) which produces the decomposition E = ^ of the Higgs 
bundle of the form ( |2.6|) belongs to Ad Pk) , that is, it is fibrewise in u(2) . Thus there 

are only two possibilities: either V = F^i/2 and V* = F1/2 with ^: V ^ V* ^ K, that 
is, 6 = (here we are using that deg{V) ^ 0. These Higgs bundles are seen to be minima 
as before. The other possibility is that V = F„i^ ® Fm^ and V* = F^mi © F_m2 , where 
F_m = F^. Note that either (mi, ma) = (-3/2,1/2) or (mi, ma) = (-1/2,3/2). In this 
case the decomposition ( p.l4| ) has the form 



AdPr 



Us, 



where 



U2 = Hom(F_3/2,Fi/2) = Hom(F_i/2, F3/2) 
Us = Hom(F„3/2,F3/2). 



From (|2.17| ) we therefore get the Morse index 



dime (C") = 2{g - 1) + deg(F3/2) - deg(F_3/2) 
- (deg(Fi/2) - deg(F_3/2)) 
= 2{g - 1) - (deg(F_3/2) + deg(Fi/2)) 
= 2{g-l)±deg{V). 

Thus we cannot have a minimum unless deg{V) = 2g — 2, and in this case, from Proposi- 

3/2 © Fi/2 since otherwise c would not be of rank 2. This gives the 

□ 



tion B.2L we have V = F_ 



second case of the proposition. 

It remains to identify the local minima of / which are not stable Higgs bundles. 
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Proposition 4.3. The reducible Higgs bundles of the form (2^) with deg{V) ^ which 
correspond to a local minimum of f on A1su(2,2) either have $ = and deg(V") = deg(\^') = 
0, or, z/ $ 7^ 0, they are direct sums of rank 2 Higgs bundles and (£'2, $2); where 

Ei = Li ® L[ , Li a line-bundle with deg(Lj) ^ and Li ^ L[ ® K . If ^i ^ then 
deg(Li) >0. 

Proof. Let {E, $) be a reducible Higgs bundle of the form ( ^.5[ ) which is a local minimum 
of /. Consider A1su(2,2) as the space of solutions (A, $) to Hitchin's equations modulo 
S(U(2) X U(2)) gauge equivalence. 

First consider the case $ = 0. Then, by poly-stability, deg(V^) = deg(l^') = 0, and V 
and V are poly-stable vector bundles. On the other hand, it is clear that such Higgs bundles 
are, in fact, reducible (absolute) minima of /. This gives the first case of the proposition. 

Suppose now that $ 7^ . The possible reductions of structure group are the following. 

Reduction to S((U(1) x U(l)) x (U(l) x U(l))) . In this case we have V = Li ® L2 for 
linebundles Li and L2 , while V = L[ © L2 . Thus {E, $) is the direct sum of two Higgs 
bundles (£'i,$i) and (E2,$2), where Ei = Li® L[, LiL[L2L'2 = O, and the Higgs field $i 
has zeros along the diagonal. Note also that deg{Ei) = by poly-stability of {E, $) . Each 
of the bundles {Ei, $«) is a minimum on the moduli space of rank 2 Higgs bundles of this 
form and hence of the form ( p.l4| ), in other words all components of $j are zero, except one 



off-diagonal entry, (cf. Hitchin [|T5l, Section 10). 

There are now two cases to consider. The first case is when $ is zero on one of the 
bundles V and V; since deg(V^) ^ we must have V —>■ V ® K . In other words, $ is 
of the form 


c 

with respect to the decomposition E = V (B V . Thus {E, $) is of the form considered in 
Proposition [4.1| . As in the proof of that proposition one sees that there is no subspace of the 
Zariski tangent space with negative weights and, therefore, these Higgs bundles represent 
local minima of /. This case includes the case of one of the $j being equal to zero. Note 
that, if deg(Lj) = then it follows from (|2.16| ) and the remark following it that $j = 0. 



This case gives the remaining local minima of the statement of the proposition. 

The other case is when $ is non-zero on both V and V , say that $1: Li L[ ® K 
and ^2-L'2^L2^K. By stability, and since $ 7^ 0, we then have deg(L'^) < and 
deg(L2) < 0, and so deg(Li) > and deg(L2) > 0. We shall show that in this case {E, $) 
is not a local minimum of /. Let the infinitesimal gauge transformation ip which produces 
the decomposition Ei = Li® L\ of ( p. 14 ) have weights rrii on Lj, and weights on L'^. 



We then have the following equations relating these numbers: 

m\ = mi + 1, 
m2 = m'2 + 1, 



From these equations it follows that (m2— mi) + (m']^— m'g) = 2 and hence, either m2—mi ^ 1 
or m[ — m'2 ^ 1 . For definiteness suppose that m2 — nii ^ 1 (the other case is entirely 
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similar). This means that 

Hom(Li, L2) C Adfc Pk = (End(V) © End{V'))^ 

has weight ^ 1 and that this is a subspace of the highest weight space of ip . Note that 
ad($) is zero restricted to the highest weight space and so if^(S; Hom(Li, L2)) gives a 
subspace of EI^(C*) on which / is negative. But since deg(Li) ^ and deg(L2) < we 
have Hom(Li, L2)) = and therefore, from Riemann-Roch, H^{Ti] Hom(Li, L2)) 7^ 0. 

It only remains to find a smooth family of Higgs bundles in A^su(2,2) to which an element 
in if^(S; Hom(Li, L2)) is tangent (cf. Section p.5| ). By hypothesis (-£',$) is the direct sum 
of the stable Higgs bundles {Ei,^i) and {E2,^2)- All extensions 



0^ E2^ E ^ El 







are parametrized by H^(Il;}iom{Ei, E2)) so, in particular, t G iJ^(S; Hom(Li, L2)) defines 
an extension 



— > E2 — ^ Et — > El 







which is non-trivial if t 7^ . Note that E = Vt (B V , where Vt is the non-trivial extension 

0^L2^Vt^Li^0 

defined by t . We define a Higgs field $ = ( ct 0* ) '^^ the appropriate form in the 

following way. To define bt: V —>■ Vt ® K we use the composition 

V ^L2®K ^ Vt®K, 
while to define q : Vt V' ® K we use the composition 

Vt Li ®K. 

For t 7^ the Higgs bundle {Et, is a non-trivial extension of stable Higgs bundles and 
therefore stable. For a G C, the family {Eat-, ^at) is thus a smooth family of Higgs bundles 
in A^su(2,2) to which t G if^(E; Hom(Li, L2)) is tangent. 

Reduction to S((U(1) x U(l)) x U(2)) . In this case we have a decomposition of {E, $) as 
a direct sum of Higgs bundles (£"1, $1) and {E2, $2), where Ei = V ® Li and E2 = L2 with 
Li and L2 linebundles. Again and (i?2,$2) represent local minima on lower rank 

moduli spaces and so, $2 = 0. If (ii^i,<l>i) is reducible we are back in one of the previous 
cases so we may assume that [Ei, $1) is stable. Since we are at a minimum it must be of 
the form (|2.14|) and again there are several possibilities. If $1 is zero on either V or Li 
then it is zero on either V or V and [E, $) is a minimum as above. Thus the only case 
that remains is when V = F„i © Fi and $: F_i Li® K , and : Li ^ Fi ® K . The 
weights of the infinitesimal gauge transformation producing this decomposition are —1,0, 
and 1 on Li , and Fi, respectively. As above one sees that Hom(F_i, Fi)) gives 

a subspace of EI^(C* ) on which / is negative and that t G Hom(F„i, Fi)) is tangent 

to a smooth family of Higgs bundles, so that (F, $) does not represent a local minimum. 
We omit the details. 

Reduction to S(U(2) x (U(l) x U(l))) . This case is analogous to the previous one. □ 
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In an analogous manner one can prove the following proposition. 



Proposition 4.4. The reducible Higgs bundles of the form (2^) with deg{V) ^ which 
correspond to a local minimum of f on 7Vlsp(2,M) either have $ = and deg(y) = 0, 
or, if ^ ^ 0, they are direct sums of rank 2 Higgs bundles and (£2,^2), where 

Ei = Li® L^^ , Li a line-bundle with deg(Lj) ^ and Li ^ Lj^ ® K . If ^ then 
deg(Li)>0. □ 



5 Connected Components 
5.1 Components of A^su(2,2) 



In this section we consider the connected components of A1su(2,2) • Using Proposition |3]2 we 
can write 

A^SU(2,2) = M^(2g~2) U ■ ■ ■ U A^2g-2, 



where Aid, the subspace of Higgs bundles of the form ^]5| with deg(V) = d, is a union of 
connected components. Denote the subspace of local minima of / on A^^ by A/^. Note that, 
since / is proper, connectedness of Afd implies connectedness of Aid- As noted in Section ^ 
we can without loss of generality assume that d ^ 0. The results of the previous section 
then give the following identification of A/^. 

Proposition 5.1. The subspace of local minima of f on A4d, Afd, is the space of poly- stable 
Higgs bundles of the form with 6 = 0. 



Proof. Immediate from Propositions ^]T| and [4.3| . □ 



We can use this to identify Afd with a moduh space of triples, as studied by Bradlow 
and Garci'a-Prada [|, |10|- Denote the moduli space of stable triples (y,V',(j)) (where e 
H%E;Rom{V,V')), deg{V) = d, deg{V') = 2g-2-d, and ik{V) = rk(V') = 2) by AAf^^"' 
(cf. Section p73|) . To each such triple we associate a Higgs bundle (V © V, 0)), where 
V = V' ® K^^ . The following theorem is then an immediate consequence of Theorem |273. 



Theorem 5.2. Afd is isomorphic to the fibre, over the trivial bundle O, of the map 

(V, V', 0) h-^ ^^{y) ® ^^{y') ® k-\ 

□ 

Thus information about connectedness of moduli spaces of stable triples would give in- 
formation about connectedness of the Aid and we hope to come back to this on a later 
occasion. At present we can prove the following theorem. 

Theorem 5.3. The subspaces Aid of Aisv {2, 2) o'^e connected for d = and d = ±(2g — 2). 
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Proof. First consider the case d = 0. To see that Ao is connected, consider the continuous 
map 



NqX NqX Jac(S) Afo 

{E, E', L) ^ {{E ® L) © {E' ® L-'), 0) 



where Nq denotes the moduh space of rank 2 poly-stable vector bundles with fixed trivial 



determinant bundle. From Proposition |5.1| we see that this is surjective and, since A^o and 
Jac(E) are connected, that A/q is connected. 

Next consider the case d = 2g — 2 (as already noticed, this also takes care of the case 
d = —{2g — 2) ). From Propositions |3]^ and |5.1| we see that Af2g-2 is isomorphic to the moduli 
space of rank 2, degree 2g — 2 vector bundles with fixed determinant, which is known to be 
connected. □ 

5.2 Components of A^sp(4,M) 

In this section we consider the connected components of M.sp{4,«.)- Again using Proposi- 



tion |3.1| we can write 

A^Sp{4,K) = A^-(2g-2) U ■ ■ ■ U A^2<;-2, 

where A4d, the subspace of Higgs bundles of the form ^]6| with deg(V^) = d, is a. union of 
connected components. Again we denote the subspace of local minima of / on Aid by Ad, 
and connectedness of Md implies connectedness of A^^. 

We can also identify A/^ with a moduli space of triples, using Theorem |2.3| , as follows. 

Theorem 5.4. For —{2g — 2) ^ d ^ 2g — 2 , A^ is the isomorphic to the fixed point set of 
the involution on the moduli space Ai^J^''^^^^ of poly-stable triples (as defined in the previous 
section), defined by 

^triples _^ _y^triples 

(V, V', 0) ^ A'^iV) ® A\V') ® 

□ 

With regard to connectedness, we consider the cases \d\ < 2g — 2 and \d\ = 2g — 2 
separately. 

The case \d\ < 2g — 2. In this case everything is completely analogous to the case of 
SU(2, 2) -bundles. To begin with, we have the following result. 

Proposition 5.5. For \d\ <2g — 2, the subspace of local minima of f on M.d, Afd, is the 
space of poly-stable Higgs bundles of the form WE with 6 = 0. 



Proof. Follows from Propositions W7I and [4.4|. □ 



We have the following result about connectedness of M. 



0- 
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Theorem 5.6. The subspace A4q of A^sp{4,M) is connected. 

Proof. From Proposition ^.51 it follows in particular that Aq is isomorphic to the moduli 
space of rank 2, degree poly-stable vector bundles. Since this space is connected, the 
result is proved. □ 



The case = 2g — 2. In this case the results are entirely different from those of SU(2, 2)- 



bundles, due to Proposition K2 



Let be a Higgs bundle of the form (|2.6| ) with d = n{g — 1). Choosing a square 

root Lq of the canonical bundle on S , we can define a rank n vector bundle W by 

W = V®L^\ 

and we can define C e i/°(S; S'^W*) and G End(iy) ® K^) by 



C = c® l.-i, 



and 



0= (6®Ujo(c®li-i). 

Note that <^ is symmetric with respect to the quadratic form C . 

From Proposition ^.2| we know that c is an isomorphism when {E., $) is poly-stable, and 
thus we can recover {E, $) from this data. Therefore the set of isomorphism classes of Higgs 
bundles of the form ( ^2.61 ) is equal to the set of isomorphism classes of Higgs bundles 

{W,CA). (5.1) 

where W has a non-degenerate quadratic form C, and the Higgs field $ is twisted by 
and symmetric with respect to C. There is an obvious stability condition for (PV, C, 0), 
namely that 

^^{U) < ^x{W) (5.2) 

for all 0-invariant subbundles U oiW . Next, we shall prove that (PVi C, 0) is stable, if and 
only if {E, $) is. 

Theorem 5.7. The subspace M.n(g-i) C M.sp{2n,w) of Higgs bundles of the form ( p.6|) , with 
d = n{g — l) is isomorphic to the moduli space of poly- stable Higgs bundles of the form (|5.1|) . 

Proof. We have to prove that {E, $) is stable if and only if [W, C, (p) is. From Theorem |2.3| 
we know that stability of (E,^) is equivalent to stability of the Q-bundle E = (^, $). 
Thus, all we need to prove is that E is stable if and only if {W, C, 0) is. Because stability is 
unaffected by tensoring with a line bundle, we can equally well prove that (V, boa) is stable. 
Note, that fx{V) = g-l. 

Assume E is a stable Q-bundle. Let ?7 C be a 0-invariant subbundle. Let U' C V* 
be the subbundle such that U' ® K is generically the image of U under c. Then h maps U' 
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to U , because of the 0-invariance of U . Hence, F = ({[/, U'}, {b, c}) defines a Q-subbundle 
of E, and it follows that 



/.(F) < /i(E). (5.3) 

But, as c is an isomorphism 

/i(E) = /x(^) 

= fi{V®V®K-^) 
= ^,{V)-ig-l), 

and similarly fi{F) = fi{U) — {g — 1) . Therefore fi{U) < /i(V^) and so, (W,C,(f)) is stable. 

Conversely, assume that (W,C,(j)) is stable. Let F = {{U,U'}, {b,c}) be a Q-subbundle 
of E. Let U G V* he the subbundle which is generically the image of U' ® K under c^^. 
Both U and U are 0-invariant subbundles of V ^ because F is a Q-subbundle. Hence, 
jiiU) < niy) and /i(f/') < iiiy) , by stability of {W, C, (j)) . Recalling that iJ,{V) = g-l and 
fiiU)=fiiU')-i2g-2),weget 

KU) <g-i, (5.4) 

and 

f,{U')<-ig-l). (5.5) 

Note also that 

rk([/') ^ Tk{U), (5.6) 

because c is an isomorphism, and the image of U under c is contained in U' ^ K , hj the 
assumption that F is a Q -subbundle. Combining (|5l^), ( |5.5| ), and (|5.6|) , we get: 

/i(F) = /i(f/ © f/') 

rk(f/) rk([/') 



rk(f/©[/')'^' ' rk(f/©[/' 
rk([/) - rk([/0 _ 
rk(f/©?7') ^ 

^ 0. 

Of course, /i(E) = and hence the proof is finished. □ 

The existence of the quadratic form C on W means that the structure group is 0(n, C) . 
The maximal compact subgroup of 0(n, C) is 0(n) and, therefore, we have the Stiefel- 
Whitney classes Wi and W2 as topological invariants. We now specialize to the case n = 
2. The first Stiefel- Whitney class can then be seen in holomorphic terms as follows: the 
quadratic form C gives an isomorphism (A^W^)^ = O; hence, A^W gives an element of 
iJ^(S;Z/2), and it is easy to see that this element is wi{W) . It follows that A'^W = O 



22 



if and only if wi{W) = 0. This, in turn, is equivalent to the existence of a reduction of 
structure group to S0(2, C) C 0(2, C) . Using the identification = S0(2, C) via 

we see that this happens exactly when W decomposes as a direct sum 

W^L®L-\ 

and C is of the form 




with respect to this decomposition. Now it is clear that, in this case, ^2(1^) is given by 

W2 = Ci(L) mod 2. 

By interchanging L with its dual if necessary, we may assume that deg(L) ^ 0. Furthermore, 
when deg(L) > 0, the Higgs field 4> must induce a non-zero holomorphic map 

L ^ L-lir^ 

because otherwise L G W would violate stability Hence, we have 

deg(L) ^2^-2. 

We, therefore, have a decomposition of A42g-2 into subspaces, each of which is a union 
of connected components, as follows: 

23-2 

•M2,-2 = (Um;:)u(|Jm[,), 

u,v 1=0 

where is the moduli space of poly-stable Higgs bundles {W,C,(f)) with Wi{W) = -u G 
H\T.]Z/2) - {0} and W2(V) = v e H'^{T.]Z/2), and where M[, is the moduh space of 
poly-stable Higgs bundles (W, C, 0) with wiiW) — and deg(L) = I. We shall prove that 
each of these subspaces is connected, except Mq^~^ : in this case the Higgs field (t) induces 
a non-zero section of the degree linebundle L^^K^ and thus = . We therefore 
have a further decomposition of of Mq^"^ into subspaces Mq^^^ , indexed by the 2^^ square 
roots L G Jac^^~^(S) of K"^ (note the analogy with the breaking up of ^^23-2 into several 
connected components). 

We can now state our main result, to be proved in the remaining part of this section. 

Theorem 5.8. i) The spaces Mq^^^ are connected. 

ii) The spaces Mq are connected for ^ I < 2g — 2. 
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in) The spaces are connected. 



Remark 5.9. Hitchin showed in [IV] that for any spht real form Gr of a complex simple 
Lie group the moduli space of reductive representations of vri(S) in Gr contains a connected 
component which is homeomorphic to an Euclidean space of dimension {2g — 2) dimG^- This 
component is called the Teichmiiller component. The group Sp(4, M) is a split real form of 
Sp(4, C) so there is a Teichmiiller component in this case. As a matter of fact, each of the 
subspaces Mg^^^ is isomorphic to a vector space: note that W = L (B is completely 
determined by L and that any (W, C, (p) is stable. Hence Mq^^^ is isomorphic to the space 
of Higgs fields G End(iy) ® K"^) which are symmetric with respect to C = (? J), 

that is, of the form = ( ) . It follows that Mq^^^ is isomorphic to the vector space 

Note that this proves i) of the theorem. 



Remark 5.10. One can see (see |]T3| for details), that the subspaces Aid, M^, Mg, and 
Mg^^^ are non-empty. Therefore, Theorem p75| shows that A^sp(4,iR) has at least 3-2^^+85'— 13 
connected components. 

Proof that the subspaces Mg C A^2g-2 are connected. Recall that any (W, C, cp) 
in Mg is of the form 



W = L®L-^ 



with / = deg(L) and C of the form (lo). First, we consider the case of / > 0. In this 
case, the Higgs field must be non-zero, as otherwise the subbundle L G W would violate 
stability. But any critical point of the type described in i) of Proposition ^]2| has = 



so, it follows that all the critical points in Mg for / > are of the type described in ii) 
of Proposition |4.2| . We therefore see that the critical points correspond to Higgs bundles 
{W, C, 0) , which are of the form described above and where, furthermore, is of the form 





with G [Tj] L^"^ K'^) . Using this, it is now easy to give an explicit description of the 
subspace of local minima of / on Mg. 

Proposition 5.11. The subspace of local minima Nq C Mq fits into a pull-back diagram 

Nl^ y Jac'(S) 

where niW, C, 0) = (0) . 
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Proof. The only thing there is to remark is that any {W, C, 0) , of the form given above, is 
stable. But, L^^ C is the only 0-invariant subbundle so, this is obvious. □ 



From this proposition, it is clear that A^^q is connected so, from the properness of /, it 

3WS that Mq is connected for / > 0. 

In the case / = 0, we have the following result. 



Proposition 5.12. Any local minimum of f on Mg has = and is, therefore, of the 
type described in i) of Proposition [^.ij. 



Proof. Suppose we have a critical point of the type described in ii) of Proposition [4.2| , with 
7^ 0. Then, L^^ G W is 0-invariant and therefore, (VF, C, 0) is semi-stable, but not 
stable. Since we are considering the moduli space of poly-stable Higgs bundles, {W, C, 0) 
decomposes as a direct sum of rank 1 Higgs bundles of degree . The only subbundles of 
W of rank 1 and degree are L and , and L is not 0-invariant so, we conclude that 
this situation cannot occur. □ 

Consequently, we have the following description of the subspace of local minima of / on 
Ml 

Proposition 5.13. The subspace Nq C Mq of local minima of f is isomorphic to the 
moduli space of poly-stable {W,C), where W is of the form 

W = L®L-\ 

for a linebundle L of degree 0, and C is of the form ( ? J), with respect to this decomposition. 

Note that the pair {W, C) decomposes into a direct sum of Higgs linebundles exactly 
when = O , and it is then poly-stable, but not stable. All other {W,C) are stable. It 
follows that there is a surjective continuous map 

Jac°(S) ^ N^, 

given by taking L to {W, C) of the form given above. Therefore, A'^^ is connected, finishing 
the proof that the subspaces Mq are connected. 

Proof that the subspaces M^ C A^2g-2 cire connected. We begin by noting that 



the {W, C, 0) corresponding to a critical point of the type described in ii) of Proposition 
has Wi{W) = 0, thus we see that the subspaces of local minima A^^ C M^ consist of critical 
points of the type described in i) of Proposition [4.2| . Recall that for these 6 = 0; in terms of 
the Higgs bundle {W, C, 0) , this means that = 0. Thus, is the moduli space of stable 
pairs {W, C) with the given characteristic classes. From A^W ^ O , one sees easily that any 
such pair is stable. 

There is a connected double cover S — > S given by 

Wi{W) e H\J:; Z/2) = Hom(7riE, Z/2). 
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Clearly, the pull-back of W to^ S is of the form 7r*W = M © M"^ with tt*C = (H) and 
M a linebundle. Let r: S — S be the involution interchanging the sheets of the covering, 
then, clearly, 

T*M = M-\ 

Conversely, if M is a linebundle on S which satisfies this condition, then W = n^^M is a 
rank 2 vector bundle with a non-degenerate quadratic form C . In fact E is the spectral 
curve associated to {W,C) (see Hitchin and Beauville, Narasimhan and Ramanan 0). 
Hence U A^^ can be identified with the kernel of the map 

1 + r*: Jac(S) ^ Jac(S), 

where S is the unramified double cover of S given by m G Z/2). 

It remains to distinguish between W2 being equal to or 1. When the cover is unramified, 
the kernel of 1 -|- r* splits into two components, 

ker(l + r*) = P+ U P' , 

each of them a translate of the Prym variety of the covering. It is a classical theorem of 
Wirtinger, that the function 6: U P^ ^ Z/2, defined by 

5(M) = dimci/°(S;M®7r*Lo) mod 2 
= dimci/°(S;7r,M® Lo) mod 2, 

is constant on each of P~^ and P~ and takes different values on them. For proofs of these 



facts, see Mumford [2C] or [21 



Now, let F — >■ S be a real vector bundle. Choosing a metric on F , the complexification 
F'^ = F ®]R C acquires a holomorphic structure and therefore, there is a 9-operator 

dL,iF) : ^]°(E; Lq ® F') Lq ® F^). 

Atiyah [|1| shows that the function 

6lo{F) = dime ker {Bl, (F)) mod 2 

is independent of the choice of the metric, and that it extends to give a group homomorphism 

6l,: irO(S) ^Z/2. 

Define 7 G K0{I1) to be the pull-back of the generator of KO{S'^) under a map S ^ S*^ of 
degree 1. Atiyah Lemma (2.3)] shows that 

Furthermore, the total Stiefel- Whitney class gives an isomorphism 

w: KOiT.) {1} ® H\T.-Z/2) ® H\T.-Z/2) 
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of the additive group i^O(E) onto the multiphcative group of the cohomology ring H*(T,; Z/2) 
(see [0 Remark, p. 54]). Clearly, 

u;(7) = (1,0,1), 

where we identify i?^(S; Z/2) = Z/2. We may, therefore, think of Slq as a homomorphism 
of the multiplicative group of if*(S;Z/2) to Z/2, which takes the value 1 on the element 
(1, 0, 1) . Let M e H\J:; Z/2) ; then, 

(1,^,0) = (l,n,l)- (1,0,1) 

in iJ*(S;Z/2). Therefore, 

<5i„(l,n,0) = 5Lo(l,w,l) + l- (5.7) 
Returning to {W, C) with W = n^M for M G ker(l + r*) , we see that 

where is a real rank two bundle, whose complexification is W^. It follows from ( |5.7| ), 
that 6 takes different values for different values of W2{W) and hence, that W2{W) determines 
whether M lies in P+ or . 

From this discussion, we obtain the following explicit description of the subvariety N'^^ C 
of local minima of / . 

Proposition 5.14. Let u G ifi(S;Z/2) - {0}, let v e H^{J:;Z/2) = Z/2 and let P+ and 

P be the Abelian varieties associated to the double cover of S, given by u as above. Then, 
the subvariety C of local minima of f is equal to P^ and P^ , respectively, for the 
two values of v . □ 

Consequently, is connected and, from the properness of /, it follows that is 



connected, finally finishing the proof of Theorem 5.8 
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